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1 

METHODOLOGY AND METHOD AND 
APPARATUS FOR SIGNALING WITH 
CAPACITY OPTIMIZED CONSTELLATIONS 

CROSS-REFERENCE TO RELATED 
APPLICATIONS 

The present invention claims priority to U.S. Provisional 
Application Ser. No. 60/933,319 entitled “New Constella- 
tions for Communications Signaling: Design Methodology 
and Method and Apparatus for the New Signaling Scheme” to 
Barsoum et ah, filed Jun. 5, 2007, the disclosure of which is 
expressly incorporated by reference herein in its entirety. 

STATEMENT OF FEDERALLY SPONSORED 
RESEARCH 

This invention was made with Government support under 
contract NAS7-03001 awarded by NASA. The Government 
has certain rights in this invention. 

BACKGROUND 

The present invention generally relates to bandwidth and / 
or power efficient digital transmission systems and more spe- 
cifically to the use of unequally spaced constellations having 
increased capacity. 

The term “constellation” is used to describe the possible 
symbols that can be transmitted by a typical digital commu- 
nication system. A receiver attempts to detect the symbols 
that were transmitted by mapping a received signal to the 
constellation. The minimum distance (d mif1 ) between constel- 
lation points is indicative of the capacity of a constellation at 
high signal-to-noise ratios (SNRs). Therefore, constellations 
used in many communication systems are designed to maxi- 
mize d min . Increasing the dimensionality of a constellation 
allows larger minimum distance for constant constellation 
energy per dimension. Therefore, a number of multi-dimen- 
sional constellations with good minimum distance properties 
have been designed. 

Communication systems have a theoretical maximum 
capacity, which is known as the Shannon limit. Many com- 
munication systems attempt to use codes to increase the 
capacity of a communication channel. Significant coding 
gains have been achieved using coding techniques such as 
turbo codes and LDPC codes. The coding gains achievable 
using any coding technique are limited by the constellation of 
the communication system. The Shannon limit can be thought 
of as being based upon a theoretical constellation known as a 
Gaussian distribution, which is an infinite constellation where 
symbols at the center of the constellation are transmitted 
more frequently than symbols at the edge of the constellation. 
Practical constellations are finite and transmit symbols with 
equal likelihoods, and therefore have capacities that are less 
than the Gaussian capacity. The capacity of a constellation is 
thought to represent a limit on the gains that can be achieved 
using coding when using that constellation. 

Prior attempts have been made to develop unequally 
spaced constellations. For example, a system has been pro- 
posed that uses unequally spaced constellations that are opti- 
mized to minimize the error rate of an uncoded system. 
Another proposed system uses a constellation with equiprob- 
able but unequally spaced symbols in an attempts to mimic a 
Gaussian distribution. 

Other approaches increases the dimensionality of a con- 
stellation or select a new symbol to be transmitted taking into 
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consideration previously transmitted symbols. However, 
these constellation were still designed based on a minimum 
distance criteria. 

5 SUMMARY OF THE INVENTION 

Systems and methods are described for constructing a 
modulation such that the constrained capacity between a 
transmitter and a receiver approaches the Gaussian channel 
to capacity limit first described by Shannon [ref Shannon 1 948] . 
Traditional communications systems employ modulations 
that leave a significant gap to Shannon Gaussian capacity. The 
modulations of the present invention reduce, and in some 
cases, nearly eliminate this gap. The invention does not 
15 require specially designed coding mechanisms that tend to 
transmit some points of a modulation more frequently than 
others but rather provides a method for locating points (in a 
one or multiple dimensional space) in order to maximize 
capacity between the input and output of a bit or symbol 
20 mapper and demapper respectively. Practical application of 
the method allows systems to transmit data at a given rate for 
less power or to transmit data at a higher rate for the same 
amount of power. 

One embodiment of the invention includes a transmitter 
25 configured to transmit signals to a receiver via a communica- 
tion channel, wherein the transmitter, includes a coder con- 
figured to receive user bits and output encoded bits at an 
expanded output encoded bit rate, a mapper configured to 
map encoded bits to symbols in a symbol constellation, a 
30 modulator configured to generate a signal for transmission 
via the communication channel using symbols generated by 
the mapper. In addition, the receiver includes a demodulator 
configured to demodulate the received signal via the commu- 
nication channel, a demapper configured to estimate likeli- 
35 hoods from the demodulated signal, a decoder that is config- 
ured to estimate decoded bits from the likelihoods generated 
by the demapper. Furthermore, the symbol constellation is a 
capacity optimized geometrically spaced symbol constella- 
tion that provides a given capacity at a reduced signal-to- 
40 noise ratio compared to a signal constellation that maximizes 

djnin’ 

A further embodiment of the invention includes encoding 
the bits of user information using a coding scheme, mapping 
the encoded bits of user information to a symbol constella- 
45 tion, wherein the symbol constellation is a capacity optimized 
geometrically spaced symbol constellation that provides a 
given capacity at a reduced signal-to-noise ratio compared to 
a signal constellation that maximizes d min , modulating the 
symbols in accordance with a modulation scheme, transmit - 
50 ting the modulated signal via the communication channel, 
receiving a modulated signal, demodulating the modulated 
signal in accordance with the modulation scheme, demapping 
the demodulated signal using the geometrically shaped signal 
constellation to produce likelihoods, and decoding the likeli- 
55 hoods to obtain an estimate of the decoded bits. 

Another embodiment of the invention includes selecting an 
appropriate constellation size and a desired capacity per 
dimension, estimating an initial SNR at which the system is 
likely to operate, and iteratively optimizing the location of the 
60 points of the constellation to maximize a capacity measure 
until a predetermined improvement in the SNR performance 
of the constellation relative to a constellation that maximizes 
d min has been achieved. 

A still further embodiment of the invention includes select- 
65 ing an appropriate constellation size and a desired capacity 
per dimension, estimating an initial SNR at which the system 
is likely to operate, and iteratively optimizing the location of 
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the points of the constellation to maximize a capacity mea- 
sure until a predetermined improvement in the SNR perfor- 
mance of the constellation relative to a constellation that 
maximizes d min has been achieved. 

Still another embodiment of the invention includes select- 5 
ing an appropriate constellation size and a desired SNR, and 
optimizing the location of the points of the constellation to 
maximize a capacity measure of the constellation. 

A yet further embodiment of the invention includes obtain- 
ing a geometrically shaped PAM constellation with a constel - 1 0 
lation size that is the square root of said given constellation 
size, where the geometrically shaped PAM constellation has 
a capacity greater than that of a PAM constellation that maxi- 
mizes d min , creating an orthogonalized PAM constellation 15 
using the geometrically shaped PAM constellation, and com- 
bining the geometrically shaped PAM constellation and the 
orthogonalized PAM constellation to produce a geometri- 
cally shaped QAM constellation. 

Another further embodiment of the invention includes 20 
transmitting information over a channel using a geometri- 
cally shaped symbol constellation, and modifying the loca- 
tion of points within the geometrically shaped symbol con- 
stellation to change the target user data rate. 

25 

BRIEF DESCRIPTION OF DRAWINGS 

FIG. 1 is a conceptual illustration of a communication 
system in accordance with an embodiment of the invention. 

FIG. 2 is a conceptual illustration of a transmitter in accor- 30 
dance with an embodiment of the invention. 

FIG. 3 is a conceptual illustration of a receiver in accor- 
dance with an embodiment of the invention. 

FIG. 4 a is a conceptual illustration of the joint capacity of 
a channel. 

FIG. 4 6 is a conceptual illustration of the parallel decoding 
capacity of a channel. 

FIG. 5 is a flow chart showing a process for obtaining a 
constellation optimized for capacity for use in a communica- 40 
tion system having a fixed code rate and modulation scheme 
in accordance with an embodiment of the invention. 

FIG. 6a is a chart showing a comparison of Gaussian 
capacity and PD capacity for traditional PAM-2,4,8,16,32. 

FIG. 6b is a chart showing a comparison between Gaussian 45 
capacity and joint capacity for traditional PAM-2,4,8,16,32. 

FIG. 7 is a chart showing the SNR gap to Gaussian capacity 
for the PD capacity and joint capacity of traditional PAM-2, 
4,8,16,32 constellations. 

FIG. 8a is a chart comparing the SNR gap to Gaussian 50 
capacity of the PD capacity for traditional and optimized 
PAM-2,4,8,16,32 constellations. 

FIG. 8/? is a chart comparing the SNR gap to Gaussian 
capacity of the joint capacity for traditional and optimized 
PAM-2,4,8,16,32 constellations. 

FIG. 9 is a chart showing Frame Error Rate performance of 
traditional and PD capacity optimized PAM-32 constellations 
in simulations involving several different length LDPC 
ccxtes. 60 

FIGS. lOa-lOd are locus plots showing the location of 
constellation points of a PAM-4 constellation optimized for 
PD capacity and joint capacity versus user bit rate per dimen- 
sion and versus SNR. 

FIGS. 11 a and 11 b are design tables of PD capacity and 65 
joint capacity optimized PAM-4 constellations in accordance 
with embodiments of the invention. 
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FIGS. 12a-12d are locus plots showing the location of 
constellation points of a PAM-8 constellation optimized for 
PD capacity and joint capacity versus user bit rate per dimen- 
sion and versus SNR. 

FIGS. 13 a and 136 are design tables of PD capacity and 
joint capacity optimized PAM-8 constellations in accordance 
with embodiments of the invention. 

FIGS. \4a-\4d are locus plots showing the location of 
constellation points of a PAM- 16 constellation optimized for 
PD capacity and joint capacity versus user bit rate per dimen- 
sion and versus SNR. 

FIGS. 15 a and 156 are design tables of PD capacity and 
joint capacity optimized PAM-16 constellations in accor- 
dance with embodiments of the invention. 

FIGS. 16a-16d are locus plots showing the location of 
constellation points of a PAM-32 constellation optimized for 
PD capacity and joint capacity versus user bit rate per dimen- 
sion and versus SNR. 

FIGS. 17 a and 176 are design tables of PD capacity and 
joint capacity optimized PAM-32 constellations in accor- 
dance with embodiments of the invention. 

FIG. 18 is a chart showing the SNR gap to Gaussian capac- 
ity for traditional and capacity optimized PSK constellations. 

FIG. 19 is a chart showing the location of constellation 
points of PD capacity optimized PSK-32 constellations. 

FIG. 20 is a series of PSK-32 constellations optimized for 
PD capacity at different SNRs in accordance with embodi- 
ments of the invention. 

FIG. 21 illustrates a QAM-64 constructed from orthogonal 
Cartesian product of two PD optimized PAM-8 constellations 
in accordance with an embodiment of the invention. 

FIGS. 22 a and 226 are locus plots showing the location of 
constellation points of a PAM-4 constellation optimized for 
PD capacity over a fading channel versus user bit rate per 
dimension and versus SNR. 

FIGS. 23 a and 236 are locus plots showing the location of 
constellation points of a PAM-8 constellation optimized for 
PD capacity over a fading channel versus user bit rate per 
dimension and versus SNR. 

FIGS. 24 a and 246 are locus plots showing the location of 
constellation points of a PAM-1 6 constellation optimized for 
PD capacity over a fading channel versus user bit rate per 
dimension and versus SNR. 

DETAILED DESCRIPTION OF THE INVENTION 

Turning now to the drawings, communication systems in 
accordance with embodiments of the invention are described 
that use signal constellations, which have unequally spaced 
(i.e. ‘geometrically’ shaped) points. In several embodiments, 
the locations of geometrically shaped points are designed to 
provide a given capacity measure at a reduced signal-to -noise 
ratio (SNR) compared to the SNR required by a constellation 
that maximizes d min . In many embodiments, the constella- 
tions are selected to provide increased capacity at a predeter- 
mined range of channel signal-to -noise ratios (SNR). Capac- 
ity measures that can be used in the selection of the location 
of constellation points include, but are not limited to, parallel 
decode (PD) capacity and joint capacity. 

In many embodiments, the communication systems utilize 
capacity approaching codes including, but not limited to, 
LDPC and Turbo codes. As is discussed further below, direct 
optimization of the constellation points of a communication 
system utilizing a capacity approaching channel code, can 
yield different constellations depending on the SNR for 
which they are optimized. Therefore, the same constellation 
is unlikely to achieve the same coding gains applied across all 
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code rates; that is, the same constellation will not enable the 
best possible performance across all rates. In many instances, 
a constellation at one code rate can achieve gains that cannot 
be achieved at another code rate. Processes for selecting 
capacity optimized constellations to achieve increased cod- 
ing gains based upon a specific coding rate in accordance with 
embodiments of the invention are described below. In a num- 
ber of embodiments, the communication systems can adapt 
location of points in a constellation in response to channel 
conditions, changes in code rate and/or to change the target 
user data rate. 

Communication Systems 

A communication system in accordance with an embodi- 
ment of the invention is shown in FIG. 1. The communication 
system 10 includes a source 12 that provides user bits to a 
transmitter 14. The transmitter transmits symbols over a 
channel to a receiver 16 using a predetermined modulation 
scheme. The receiver uses knowledge of the modulation 
scheme, to decode the signal received from the transmitter. 
The decoded bits are provided to a sink device that is con- 
nected to the receiver. 

A transmitter in accordance with an embodiment of the 
invention is shown in FIG. 2. The transmitter 14 includes a 
coder 20 that receives user bits from a source and encodes the 
bits in accordance with a predetermined coding scheme. In a 
number of embodiments, a capacity approaching code such as 
a turbo code or a LDPC code is used. In other embodiments, 
other coding schemes can be used to providing a coding gain 
within the communication system. A mapper 22 is connected 
to the coder. The mapper maps the bits output by the coder to 
a symbol within a geometrically distributed signal constella- 
tion stored within the mapper. The mapper provides the sym- 
bols to a modulator 24, which modulates the symbols for 
transmission via the channel. 

A receiver in accordance with an embodiment of the inven- 
tion is illustrated in FIG. 3. The receiver 16 includes a 
demodulator 30 that demodulates a signal received via the 
channel to obtain symbol or bit likelihoods. The demapper 
uses knowledge of the geometrically shaped symbol constel- 
lation used by the transmitter to determine these likelihoods. 
The demapper 32 provides the likelihoods to a decoder 34 that 
decodes the encoded bit stream to provide a sequence of 
received bits to a sink. 

Geometrically Shaped Constellations 

Transmitters and receivers in accordance with embodi- 
ments of the invention utilize geometrically shaped symbol 
constellations. In several embodiments, a geometrically 
shaped symbol constellation is used that optimizes the capac- 
ity of the constellation. Various geometrically shaped symbol 
constellations that can be used in accordance with embodi- 
ments of the invention, techniques for deriving geometrically 
shaped symbol constellations are described below. 

Selection of a Geometrically Shaped Constellations 

Selection of a geometrically shaped constellation for use in 
a communication system in accordance with an embodiment 
of the invention can depend upon a variety of factors includ- 
ing whether the code rate is fixed. In many embodiments, a 
geometrically shaped constellation is used to replace a con- 
ventional constellation (i.e. a constellation maximized for 
d min ) in the mapper of transmitters and the demapper of 
receivers within a communication system. Upgrading a com- 
munication system involves selection of a constellation and in 
many instances the upgrade can be achieved via a simple 
firmware upgrade. In other embodiments, a geometrically 
shaped constellation is selected in conjunction with a code 
rate to meet specific performance requirements, which can for 
example include such factors as a specified bit rate, a maxi- 
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mum transmit power. Processes for selecting a geometric 
constellation when upgrading existing communication sys- 
tems and when designing new communication systems are 
discussed fiirther below. 

5 Upgrading Existing Communication Systems 

A geometrically shaped constellation that provides a 
capacity, which is greater than the capacity of a constellation 
maximized for d min , can be used in place of a conventional 
constellation in a communication system in accordance with 
10 embodiments of the invention. In many instances, the substi- 
tution of the geometrically shaped constellation can be 
achieved by a firmware or software upgrade of the transmit- 
ters and receivers within the communication system. Not all 
geometrically shaped constellations have greater capacity 
1 5 than that of a constellation maximized for d min . One approach 
to selecting a geometrically shaped constellation having a 
greater capacity than that of a constellation maximized for 
d min is to optimize the shape of the constellation with respect 
to a measure of the capacity of the constellation for a given 
20 SNR. Capacity measures that can be used in the optimization 
process can include, but are not limited to, joint capacity or 
parallel decoding capacity. 

Joint Capacity and Parallel Decoding Capacity 

A constellation can be parameterized by the total number 
25 of constellation points, M, and the number of real dimensions, 
N^ m . In systems where there are no belief propagation itera- 
tions between the decoder and the constellation demapper, 
the constellation demapper can be thought of as part of the 
channel. A diagram conceptually illustrating the portions of a 
30 communication system that can be considered part of the 
channel for the purpose of determining PD capacity is shown 
in FIG. 4a. The portions of the communication system that are 
considered part of the channel are indicated by the ghost line 
40. The capacity of the channel defined as such is the parallel 
35 decoding (PD) capacity, given by: 


/-i 

c PD = 2 ux r , Y) 


where X z is the ith bit of the 1-bits transmitted symbol, and Y 
is the received symbol, and I(A;B) denotes the mutual infor- 
mation between random variables A and B. 

45 Expressed another way, the PD capacity of a channel can be 

viewed in terms of the mutual information between the output 
bits of the encoder (such as an LDPC encoder) at the trans- 
mitter and the likelihoods computed by the demapper at the 
receiver. The PD capacity is influenced by both the placement 
50 of points within the constellation and by the labeling assign- 
ments. 

With belief propagation iterations between the demapper 
and the decoder, the demapper can no longer be viewed as part 
of the channel, and the joint capacity of the constellation 
55 becomes the tightest known bound on the system perfor- 
mance. A diagram conceptually illustrating the portions of a 
communication system that are considered part of the channel 
for the purpose of determining the joint capacity of a constel- 
lation is shown in FIG. 4b. The portions of the communica- 
60 tion system that are considered part of the channel are indi- 
cated by the ghost line 42. The joint capacity of the channel is 
given by: 

C JOINT =I ( X >' Y ) 

65 Joint capacity is a description of the achievable capacity 
between the input of the mapper on the transmit side of the 
link and the output of the channel (including for example 
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AWGN and Fading channels). Practical systems must often 
‘demap’ channel observations prior to decoding. In general, 
the step causes some loss of capacity. In fact it can be proven 
that C G = C JOINT ^ C PD . That is, C JOINT upper bounds the 
capacity achievable by C PD . The methods of the present 
invention are motivated by considering the fact that practical 
limits to a given communication system capacity are limited 
by C JOINT and C PD . In several embodiments of the invention, 
geometrically shaped constellations are selected that maxi- 
mize these measures. 

Selecting a Constellation Having an Optimal Capacity 

Geometrically shaped constellations in accordance with 
embodiments of the invention can be designed to optimize 
capacity measures including, but not limited to PD capacity 
or joint capacity. A process for selecting the points, and poten- 
tially the labeling, of a geometrically shaped constellation for 
use in a communication system having a fixed code rate in 
accordance with an embodiment of the invention is shown in 
FIG. 5. The process 50 commences with the selection (52) of 
an appropriate constellation size M and a desired capacity per 
dimension r\. In the illustrated embodiment, the process 
involves a check (52) to ensure that the constellation size can 
support the desired capacity. In the event that the constellation 
size could support the desired capacity, then the process itera- 
tively optimizes the M-ary constellation for the specified 
capacity. Optimizing a constellation for a specified capacity 
often involves an iterative process, because the optimal con- 
stellation depends upon the SNR at which the communication 
system operates. The SNR for the optimal constellation to 
give a required capacity is not known a priori. Throughout the 
description of the present invention SNR is defined as the 
ratio of the average constellation energy per dimension to the 
average noise energy per dimension. In most cases the capac- 
ity can be set to equal the target user bit rate per symbol per 
dimension. In some cases adding some implementation mar- 
gin on top of the target user bit rate could result in a practical 
system that can provide the required user rate at a lower rate. 
The margin is code dependent. The following procedure 
could be used to determine the target capacity that includes 
some margin on top of the user rate. First, the code (e.g. LDPC 
or Turbo) can be simulated in conjunction with a conventional 
equally spaced constellation. Second, from the simulation 
results the actual SNR of operation at the required error rate 
can be found. Third, the capacity of the conventional constel- 
lation at that SNR can be computed. Finally, a geometrically 
shaped constellation can be optimized for that capacity. 

In the illustrated embodiment, the iterative optimization 
loop involves selecting an initial estimate of the SNR at which 
the system is likely to operate (i.e. SNR ZW ). In several embodi- 
ments the initial estimate is the SNR required using a con- 
ventional constellation. In other embodiments, other tech- 
niques can be used for selecting the initial SNR. An M-ary 
constellation is then obtained by optimizing (56) the constel- 
lation to maximize a selected capacity measure at the initial 
SNR Z „ estimate. Various techniques for obtaining an opti- 
mized constellation for a given SNR estimate are discussed 
below. 

The SNR at which the optimized M-ary constellation pro- 
vides the desired capacity per dimension r| (SNR OM ,) is deter- 
mined (57). A determination (58) is made as to whether the 
SNR owz and SNR ZW have converged. In the illustrated embodi- 
ment convergence is indicated by SNR ow , equaling SNR Z „. In 
a number of embodiments, convergence can be determined 
based upon the difference between SNR OMZf and SNR Z „ being 
less than a predetermined threshold. When SNR OM , and SNR ZW 
have not converged, the process performs another iteration 
selecting SNR oz ^ as the new SNR Z „ (55). When SNR OM , and 
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SNR ZW have converged, the capacity measure of the constel- 
lation has been optimized. As is explained in more detail 
below, capacity optimized constellation at low SNRs are geo- 
metrically shaped constellations that can achieve signifi- 
5 cantly higher performance gains (measured as reduction in 
minimum required SNR) than constellations that maximize 

^min’ 

The process illustrated in FIG. 5 can maximize PD capacity 
or joint capacity of an M-ary constellation for a given SNR. 
to Although the process illustrated in FIG. 5 shows selecting an 
M-ary constellation optimized for capacity, a similar process 
could be used that terminates upon generation of an M-ary 
constellation where the SNR gap to Gaussian capacity at a 
given capacity is a predetermined margin lower than the SNR 
1 5 gap of a conventional constellation, for example 0 . 5 db. Alter- 
natively, other processes that identify M-ary constellations 
having capacity greater than the capacity of a conventional 
constellation can be used in accordance with embodiments of 
the invention. A geometrically shaped constellation in accor- 
20 dance with embodiments of the invention can achieve greater 
capacity than the capacity of a constellation that maximizes 
d min without having the optimal capacity for the SNR range 
within which the communication system operates. 

We note that constellations designed to maximize joint 
25 capacity may also be particularly well suited to codes with 
symbols over GF(q), or with multi-stage decoding. Con- 
versely constellations optimized for PD capacity could be 
better suited to the more common case of codes with symbols 
over GF(2) 

30 Optimizing the capacity of an M-ary constellation at a given 
SNR 

Processes for obtaining a capacity optimized constellation 
often involve determining the optimum location for the points 
of an M-ary constellation at a given SNR. An optimization 
35 process, such as the optimization process 56 shown in FIG. 5, 
typically involves unconstrained or constrained non-linear 
optimization. Possible objective functions to be maximized 
are the Joint or PD capacity functions. These functions may 
be targeted to channels including but not limited to Additive 
40 White Gaussian Noise (AWGN) or Rayleigh fading channels . 
The optimization process gives the location of each constel- 
lation point identified by its symbol labeling. In the case 
where the objective is joint capacity, point bit labelings are 
irrelevant meaning that changing the bit labelings doesn’t 
45 change the joint capacity as long as the set of point locations 
remains unchanged. 

The optimization process typically finds the constellation 
that gives the largest PD capacity or joint capacity at a given 
SNR. The optimization process itself often involves an itera- 
50 five numerical process that among other things considers 
several constellations and selects the constellation that gives 
the highest capacity at a given SNR. In other embodiments, 
the constellation that requires the least SNR to give a required 
PD capacity or joint capacity can also be found. This requires 
55 running the optimization process iteratively as shown in FIG. 
5. 

Optimization constraints on the constellation point loca- 
tions may include, but are not limited to, lower and upper 
bounds on point location, peak to average power of the result- 
60 ing constellation, and zero mean in the resulting constella- 
tion. It can be easily shown that a globally optimal constella- 
tion will have zero mean (no DC component). Explicit 
inclusion of a zero mean constraint helps the optimization 
routine to converge more rapidly. Except for cases where 
65 exhaustive search of all combinations of point locations and 
labelings is possible it will not necessarily always be the case 
that solutions are provably globally optimal. In cases where 
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exhaustive search is possible, the solution provided by the 
non-linear optimizer is in fact globally optimal. 

The processes described above provide examples of the 
manner in which a geometrically shaped constellation having 
an increased capacity relative to a conventional capacity can 
be obtained for use in a communication system having a fixed 
code rate and modulation scheme. The actual gains achiev- 
able using constellations that are optimized for capacity com- 
pared to conventional constellations that maximize d min are 
considered below. 

Gains Achieved by Optimized Geometrically Spaced Con- 
stellations 

The ultimate theoretical capacity achievable by any com- 
munication method is thought to be the Gaussian capacity, C G 
which is defined as: 


C G =-\og 2 (l+SNR) 


Where signal -to-noise (SNR) is the ratio of expected signal 
power to expected noise power. The gap that remains between 
the capacity of a constellation and C G can be considered a 
measure of the quality of a given constellation design. 25 

The gap in capacity between a conventional modulation 
scheme in combination with a theoretically optimal coder can 
be observed with reference to FIGS. 6a and 6b. FIG. 6a 
includes a chart 60 showing a comparison between Gaussian 
capacity and the PD capacity of conventional PAM -2, 4, 8, 1 6, 
and 32 constellations that maximize d min , Gaps 62 exist 
between the plot of Gaussian capacity and the PD capacity of 
the various PAM constellations. FIG. 6b includes a chart 64 
showing a comparison between Gaussian capacity and the 35 
joint capacity of conventional PAM-2, 4, 8, 16, and 32 con- 
stellations that maximize d min . Gaps 66 exist between the plot 
of Gaussian capacity and the joint capacity of the various 
PAM constellations. These gaps in capacity represent the 
extent to which conventional PAM constellations fall short of 40 
obtaining the ultimate theoretical capacity i.e. the Gaussian 
capacity. 

In order to gain a better view of the differences between the 
curves shown in FIGS. 6 a and 6b at points close to the Gaus- 
sian capacity, the SNR gap to Gaussian capacity for different 45 
values of capacity for each constellation are plotted in FIG. 7. 

It is interesting to note from the chart 70 in FIG. 7 that (unlike 
the joint capacity) at the same SNR, the PD capacity does not 
necessarily increase with the number of constellation points. 

As is discussed further below, this is not the case with PAM 50 
constellations optimized for PD capacity. 

FIGS. 8a and 8b summarize performance of constellations 
for PAM-4, 8, 1 6, and 32 optimized for PD capacity and joint 
capacity (it should be noted that BPSK is the optimal PAM-2 
constellation at all code rates). The constellations are opti- 55 
mized for PD capacity and joint capacity for different target 
user bits per dimension (i.e. code rates). The optimized con- 
stellations are different depending on the target user bits per 
dimension, and also depending on whether they have been 
designed to maximize the PD capacity or the joint capacity. 60 
All the PD optimized PAM constellations are labeled using a 
gray labeling which is not always the binary reflective gray 
labeling. It should be noted that not all gray labels achieve the 
maximum possible PD capacity even given the freedom to 
place the constellation points anywhere on the real line. FIG. 65 
8a shows the SNR gap for each constellation optimized for 
PD capacity. FIG. 8b shows the SNR gap to Gaussian capac- 


ity for each constellation optimized for joint capacity. Again, 
it should be emphasized that each *+’ on the plot represents a 
different constellation. 

Referring to FIG. 8a, the coding gain achieved using a 
constellation optimized for PD capacity can be appreciated 
by comparing the SNR gap at a user bit rate per dimension of 

2.5 bits for PAM-32. A user bit rate per dimension of 2.5 bits 
for a system transmitting 5 bits per symbol constitutes a code 
rate of V 2 . At that code rate the constellation optimized for PD 
capacity provides an additional coding gain of approximately 

1 .5 dB when compared to the conventional PAM-32 constel- 
lation. 

The SNR gains that can be achieved using constellations 
that are optimized for PD capacity can be verified through 
simulation. The results of a simulation conducted using a rate 
V 2 LDPC code in conjunction with a conventional PAM-32 
constellation and in conjunction with a PAM-32 constellation 
optimized for PD capacity are illustrated in FIG. 9. A chart 90 
includes plots of Frame Error Rate performance of the differ- 
ent constellations with respect to SNR and using different 
length codes (i.e. k=4,096 and k=l 6,384). Irrespective of the 
code that is used, the constellation optimized for PD capacity 
achieves a gain of approximately 1.3 dB, which closely 
approaches the gain predicted from FIG. 8a. 

Capacity Optimized Pam Constellations 

Using the processes outlined above, locus plots of PAM 
constellations optimized for capacity can be generated that 
show the location of points within PAM constellations versus 
SNR. Locus plots of PAM-4, 8, 16, and 32 constellations 
optimized for PD capacity and joint capacity and correspond- 
ing design tables at various typical user bit rates per dimen- 
sion are illustrated in FIGS. 10a-176. The locus plots and 
design tables show PAM-4,8,16,32 constellation point loca- 
tions and labelings from low to high SNR corresponding to a 
range of low to high spectral efficiency. 

In FIG. 10a, a locus plot 100 shows the location of the 
points of PAM-4 constellations optimized for Joint capacity 
plotted against achieved capacity. A similar locus plot 105 
showing the location of the points of Joint capacity optimized 
PAM -4 constellations plotted against SNR is included in FIG. 
10 b. In FIG. 10c. the location of points for PAM-4 optimized 
for PD capacity is plotted against achievable capacity and in 
FIG. 10 d the location of points for PAM-4 for PD capacity is 
plotted against SNR. At low SNRs, the PD capacity optimized 
PAM-4 constellations have only 2 unique points, while the 
Joint optimized constellations have 3. As SNR is increased, 
each optimization eventually provides 4 unique points. This 
phenomenon is explicitly described in FIG. 11a and FIG. 11 b 
where vertical slices of FIGS. 10 ab and 10 cd are captured in 
tables describing some PAM-4 constellations designs of 
interest. The SNR slices selected represent designs that 
achieve capacities={0.5, 0.75, 1 .0, 1 .25, 1.5} bits per symbol 
(bps). Given that PAM-4 can provide at most log 2 (4)=2 bps, 
these design points represent systems with information code 
rates R={ 1 A, 3 /s, V 2 , 5 /s, 3 Aj respectively. 

FIGS. 12a6 and 12 cd present locus plots of PD capacity 
and joint capacity optimized PAM-8 constellation points ver- 
sus achievable capacity and SNR. FIGS. 13a and 13 b provide 
slices from these plots at SNRs corresponding to achievable 
capacities r|={0.5, 1 .0, 1 .5, 2.0, 2.5} bps. Each of these slices 
correspond to systems with code rate R=r| bps/log 2 (8), result- 
ing in R={ 1 / 6 , A, V 2 , 2 /3, Ve}. As an example of the relative 
performance of the constellations in these tables, consider 
FIG. 136 which shows a PD capacity optimized PAM-8 con- 
stellation optimized for SNR=9.00 dB, or 1.5 bps. We next 
examine the plot provided in FIG. 8a and see that the gap of 
the optimized constellation to the ultimate, Gaussian, capac- 
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ity (CG) is approximately 0.5 dB. At the same spectral effi- 
ciency, the gap of the traditional PAM- 8 constellation is 
approximately 1.0 dB. The advantage of the optimized con- 
stellation is 0.5 dB for the same rate (in this case R =1 / 2 ). This 
gain can be obtained by only changing the mapper and 
demapper in the communication system and leaving all other 
blocks the same. 

Similar information is presented in FIGS. 14 abed, and 
15 ab which provide loci plots and design tables for PAM-1 6 
PD capacity and joint capacity optimized constellations. 
Likewise FIGS. 16 abed, 11 ab provide loci plots and design 
tables for PAM-32 PD capacity and joint capacity optimized 
constellations. 

Capacity Optimized PSK Constellations 

Traditional phase shift keyed (PSK) constellations are 
already quite optimal. This can be seen in the chart 180 
comparing the SNR gaps of tradition PSK with capacity 
optimized PSK constellations shown in FIG. 18 where the 
gap between PD capacity and Gaussian capacity is plotted for 
traditional PSK-4,8, 16,32 and for PD capacity optimized 
PSK-4,8,16,32. 

The locus plot of PD optimized PSK-32 points across SNR 
is shown in FIG. 19 , which actually characterizes all PSKs 
with spectral efficiency r|^5. This can be seen in FIG. 20 . 
Note that at low SNR (0.4 dB) the optimal PSK-32 design is 
the same as traditional PSK-4, at SNR=8.4 dB optimal PSK- 
32 is the same as traditional PSK-8, at SNR=14.8 dB optimal 
PSK-32 is the same as traditional PSK- 16, and finally at 
SNRs greater than 20.4 dB optimized PSK-32 is the same as 
traditional PSK-32. There are SNRs between these discrete 
points (for instance SNR=2 and 15. dB) for which optimized 
PSK-32 provides superior PD capacity when compared to 
traditional PSK constellations. 

We note now that the locus of points for PD optimized 
PSK-32 in FIG. 19 in conjunction with the gap to Gaussian 
capacity curve for optimized PSK-32 in FIG. 18 implies a 
potential design methodology. Specifically, the designer 
could achieve performance equivalent or better than that 
enabled by traditional PSK-4, 8, 16 by using only the opti- 
mized PSK-32 in conjunction with a single tuning parameter 
that controlled where the constellation points should be 
selected from on the locus of FIG. 19 . Such an approach 
would couple a highly rate adaptive channel code that could 
vary its rate, for instance, rate Vs to achieve and overall (code 
plus optimized PSK-32 modulation) spectral efficiency of 4 
bits per symbol, down to Vs to achieve an overall spectral 
efficiency of 1 bit per symbol. Such an adaptive modulation 
and coding system could essentially perform on the optimal 
continuum represented by the rightmost contour of FIG. 18 . 
Adaptive Rate Design 

In the previous example spectrally adaptive use of PSK-32 
was described. Techniques similar to this can be applied for 
other capacity optimized constellations across the link 
between a transmitter and receiver. For instance, in the case 
where a system implements quality of service it is possible to 
instruct a transmitter to increase or decrease spectral effi- 
ciency on demand. In the context of the current invention a 
capacity optimized constellation designed precisely for the 
target spectral efficiency can be loaded into the transmit map- 
per in conjunction with a code rate selection that meets the 
end user rate goal. When such a modulation/code rate change 
occurred a message could propagated to the receiver so that 
the receiver, in anticipation of the change, could select a 
demapper/decoder configuration in order to match the new 
transmit-side configuration. 

Conversely, the receiver could implement a quality of per- 
formance based optimized constellation/code rate pair con- 
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trol mechanism. Such an approach would include some form 
of receiver quality measure. This could be the receiver’s 
estimate of SNR or bit error rate. Take for example the case 
where bit error rate was above some acceptable threshold. In 
5 this case, via a backchannel, the receiver could request that 
the transmitter lower the spectral efficiency of the link by 
swapping to an alternate capacity optimized constellation/ 
code rate pair in the coder and mapper modules and then 
signaling the receiver to swap in the complementary pairing 
to in the demapper/ decoder mo dules . 

Geometrically Shaped QAM Constellations 

Quadrature amplitude modulation (QAM) constellations 
can be constructed by orthogonalizing PAM constellations 
into QAM inphase and quadrature components. Constella- 
15 tions constructed in this way can be attractive in many appli- 
cations because they have low-complexity demappers. 

In FIG. 21 we provide an example of a Quadrature Ampli- 
tude Modulation constellation constructed from a Pulse 
Amplitude Modulation constellation. The illustrated embodi- 
20 ment was constructed using a PAM-8 constellation optimized 
for PD capacity at user bit rate per dimension of 1.5 bits 
(corresponds to an SNR of 9.0 dB) (see FIG. 13 /?). The label- 
point pairs in this PAM-8 constellation are {(000, -1.72), 
(001, -0.81), (010, 1.72), (011, -0.62), (100, 0.62), (101, 
25 0.02), (110, 0.81), (111, -0.02)}. Examination of FIG. 21 
shows that the QAM constellation construction is achieved by 
replicating a complete set of PAM-8 points in the quadrature 
dimension for each of the 8 PAM-8 points in the in-phase 
dimension. Labeling is achieved by assigning the PAM-8 
30 labels to the LSB range on the in-phase dimension and to the 
MSB range on the quadrature dimension. The resulting 8x8 
outer product forms a highly structured QAM-64 for which 
very low-complexity de-mappers can be constructed. Due to 
the orthogonality of the in-phase and quadrature components 
35 the capacity characteristics of the resulting QAM-64 constel- 
lation are identical to that of the PAM- 8 constellation on a 
per-dimension basis. 

N-Dimensional Constellation Optimization 

Rather than designing constellations in 1-D (PAM for 
40 instance) and then extending to 2-D (QAM), it is possible to 
take direct advantage in the optimization step of the addi- 
tional degree of freedom presented by an extra spatial dimen- 
sion. In general it is possible to design N-dimensional con- 
stellations and associated labelings. The complexity of the 
45 optimization step grows exponentially in the number of 
dimensions as does the complexity of the resulting receiver 
de-mapper. Such constructions constitute embodiments of 
the invention and simply require more ‘run-time’ to produce. 
Capacity Optimized Constellations For Fading Channels 
50 Similar processes to those outlined above can be used to 
design capacity optimized constellations for fading channels 
in accordance with embodiments of the invention. The pro- 
cesses are essentially the same with the exception that the 
manner in which capacity is calculated is modified to account 
55 for the fading channel. A fading channel can be described 
using the following equation: 

7=a(r)-X+7V 

where X is the transmitted signal, N is an additive white 
60 Gaussian noise signal and a(t) is the fading distribution, 
which is a function of time. 

In the case of a fading channel, the instantaneous SNR at 
the receiver changes according to a fading distribution. The 
fading distribution is Rayleigh and has the property that the 
65 average SNR of the system remains the same as in the case of 
the AWGN channel, E[X 2 ]/E[N 2 ]. Therefore, the capacity of 
the fading channel can be computed by taking the expectation 
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of AWGN capacity, at a given average SNR, over the Ray- 
leigh fading distribution of a that drives the distribution of the 
instantaneous SNR. 

Many fading channels follow a Rayleigh distribution. 
FIGS. 22a-24b are locus plots of PAM-4, 8, and 16 constel- 5 
lations that have been optimized for PD capacity on a Ray- 
leigh fading channel. Locus plots versus user bit rate per 
dimension and versus SNR are provided. Similar processes 
can be used to obtain capacity optimized constellations that 
are optimized using other capacity measures, such as joint 
capacity, and/or using different modulation schemes. 


What is claimed is: 

1. A digital communication system, comprising: 

a transmitter configured to transmit signals to a receiver via 
a communication channel; 
wherein the transmitter, comprises: 
a coder configured to receive user bits and output 
encoded bits at an expanded output encoded bit rate; 
a mapper configured to map encoded bits to symbols in 
a symbol constellation; 

a modulator configured to generate a signal for transmis- 
sion via the communication channel using symbols 
generated by the mapper; 
wherein the receiver, comprises: 

a demodulator configured to demodulate the received 
signal via the communication channel; 
a demapper configured to estimate likelihoods from 
the demodulated signal; 

a decoder that is configured to estimate decoded bits 
from the likelihoods generated by the demapper; 
and 

wherein the symbol constellation is a capacity opti- 
mized geometrically spaced symbol constellation 
that provides a given capacity at a reduced signal - 
to-noise ratio compared to a signal constellation 
that maximizes d min . 

2. The communication system of claim 1, wherein the 
geometrically spaced symbol constellation is capacity opti- 
mized subject to additional constraints. 

3. The communication system of claim 1, wherein the 
geometrically shaped symbol constellation is optimized for 
capacity using parallel decode capacity. 

4. The communication system of claim 1, wherein the 
geometrically shaped symbol constellation is optimized for 
capacity using joint capacity. 

5. The communication system of claim 1, wherein the code 
is a Turbo code. 

6. The communication system of claim 1, wherein the code 
is a LDPC code. 

7. The communication system of claim 1, wherein the 
modulation scheme is a PAM scheme. 

8. The communication system of claim 1, wherein the 
modulation scheme is a PSK scheme. 

9. The communication system of claim 1, wherein the 
modulation scheme is a QAM scheme. 

10. The communication system of claim 1, wherein the 
modulation scheme is a multidimensional modulation 
scheme. 

11. The communication system of claim 1, wherein the 
channel is an AWGN channel. 

12. The communication system of claim 1, wherein the 
channel is a fading channel. 

13. The communication system of claim 1, wherein the 
constellations points of the geometrically spaced symbol con- 
stellation are variable depending on the user rate. 
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14. The communication system of claim 13, wherein: 
the transmitter is configured to modify the rate of the code 

in order to change the user bit rate of the communication 
system; 

the transmitter is configured to move the constellation 
points of the symbol constellation used by the mapper 
based upon the code rate of the coder; 
the receiver is configured to receive information concern- 
ing code rate changes from the transmitter; and 
the receiver is configured to modify the decoder and the 
constellation used by the demapper in response to 
receipt of a notification of a change of user bit rate. 

15. The communication system of claim 14, wherein: 
the receiver is configured to acknowledge receipt of a 

modification to the code rate and the constellation of the 
communication system; and 

the transmitter is configured to commence transmitting 
using the new code rate and symbol constellation upon 
receipt of the acknowledgement from the receiver. 

16. The communication system of claim 15, wherein: 

a backchannel communication link exists between the 
transmitter and the receiver; 

the receiver is configured to monitor receiver performance 
and initiate a change in code rate in response to the 
observed receiver performance; 
the receiver is configured to transmit to the transmitter via 
the backchannel a change in user bit rate; and 
both the mapper and the demapper are configured to move 
the constellation points of the geometrically shaped 
symbol constellation based upon the change in user bit 
rate. 

17. The communication system of claim 1, wherein the 
constellations points of the geometrically spaced symbol con- 
stellation are variable depending on the channel. 

18. The communication system of claim 17, wherein the 
constellations points of the geometrically spaced symbol con- 
stellation are variable depending on the channel SNR. 

19. The communication system of claim 18, wherein: 

a backchannel communication link exists between the 
transmitter and the receiver; 

the receiver is configured to transmit information to the 
transmitter from which the transmitter can compute the 
channel SNR; 

the transmitter is configured to transmit to the receiver 
information indicative of a symbol constellation and a 
code configuration; and 

the demapper is configured to move the constellation 
points of the geometrically shaped symbol constellation 
based upon the information received from the transmit- 
ter. 

20. A method of transmitting bits of user information 
between a transmitter and a receiver over a communication 
channel, comprising: 

using a coder within the transmitter to encode the bits of 
user information in accordance with a coding scheme; 
using a mapper within the transmitter to map the encoded 
bits of user information to a symbol constellation, 
wherein the symbol constellation is a capacity optimized 
geometrically spaced symbol constellation that provides 
a given capacity at a reduced signal-to -noise ratio com- 
pared to a signal constellation that maximizes d min ; 
using a modulator within the transmitter to modulate the 
symbols in accordance with a modulation scheme; 
transmitting the modulated signal via the communication 
channel using the transmitter; 
receiving a modulated signal at the receiver; 
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using a demodulator within the receiver to demodulate the 
modulated signal in accordance with the modulation 
scheme; 

using a demapper within the receiver to demap the 
demodulated signal using the geometrically shaped sig- 5 
nal constellation to produce likelihoods; and 

decoding the likelihoods using the receiver to obtain an 
estimate of the decoded bits. 

21 . The method of claim 20 , wherein the geometrically 
shaped symbol constellation is optimized for capacity using to 
parallel decode capacity. 

22 . The method of claim 20 , wherein the geometrically 
shaped symbol constellation is optimized for capacity using 
joint capacity. 

23 . A method of transmitting bits of user information 15 
between a transmitter and a receiver over a communication 
channel, comprising: 

transmitting information over a channel using a geometri- 
cally shaped symbol constellation; 

determining the locations of points within a symbol con- 20 
stellation having a fixed number of constellation point to 
achieve an initial target user data rate; 

configuring the transmitter and the receiver using the sym- 
bol constellation; 

using the transmitter to: 
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encode the bits of user information in accordance with a 
coding scheme; 

map the encoded bits of user information to the symbol 
constellation; 

modulate the symbols in accordance with a modulation 
scheme; 

transmit the modulated signal via the communication 
channel: 

using the receiver to: 

receive modulated signals transmitted by the transmit- 
ter; 

demodulate the modulated signal in accordance with the 
modulation scheme; 

demap the demodulated signal using the signal constel- 
lation to produce likelihoods; 

decode the likelihoods to obtain an estimate of the 
decoded bits; 

modifying the locations of the fixed number of points 
within the geometrically shaped symbol constellation 
to change the target user data rate; and 

configuring the transmitter and the receiver with the 
modified symbol constellation during the transmis- 
sion of bits of user information. 



